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A METHOD AND APPARATUS FOR AN 
ACTIVE STANDBY CONTROL SYSTEM ON A NETWORK 

DESCRIPTION 

Related Applications 

The subject matter of the present application is related to the following 
commonly assigned applications, U.S. Patent Application No. 09/612,636, filed on 
July 7, 2000, entitled "A Method And Apparatus For An Active Standby Control^ 
System On A Network" and U.S. Patent Application No.A? /7o7 , #ft Attorney 
Docket No. SAA-52 (401 P 235), filed simultaneously with this patent application, 
entitled, "A Method And Apparatus For An Active Standby Control System On A 
Network." The contents of these Applications are expressly incorporated herein by 
reference. 

Technical Field 

The present invention relates to a control system. More particularly, the 
present invention relates to a control system utilizing a backup configuration of 
controllers on a network. 

Background of the Invention 

Controllers such as programmable logic controllers (PLC) have been 
implemented in duplex or back-up system configurations where downtime of a 
system cannot be tolerated. Such a control system delivers high reliability through 
redundancy. Generally, the duplex configuration incorporates a pair of PLCs 
assembled in a hot or active standby, or back-up, configuration wherein one PLC 
is operating in a primary mode and the other PLC is functioning in a secondary or 
standby/backup mode. The primary controller runs an application by scanning a 
user program to control and monitor a remote IO network. The other, secondary, 



controller acts as the active standby controller. The standby controller does not 
run the application and it does not operate the remote 10. The standby controller 
is updated by the primary controller with each scan. The standby controller is then 
ready to assume control of the control system within one scan if the primary 
controller fails to operate or is removed from operation. 

The primary and secondary controllers are interchangeable and can be 
swapped or switched when desired. Either controller can be placed in the primary 
state. The active standby configuration requires the non-primary controller to be 
placed in the standby mode to secure the system's redundancy. The controllers 
continuously communicate with each other to ensure the operability of the control 
system. The communication among the controllers is used to determine if a swap 
of the controllers should be initiated due to a system failure or by election of an 
operator. 

Factory automation systems are increasingly being integrated with 
communication networks. Control systems are being implemented on networks 
for remote monitoring and control of devices, processes, etc. System failures 
involving the primary mode controller that can shut down the control system are 
avoided by having a back-up controller readily available in hot/active standby 
mode to replace the failing primary mode controller. 

Signal communication between device modules on a network requires 
network identifiers, i.e., Internet Protocol address, Media Access Control address; 
to be assigned to these devices throughout the network. Problems arise when the 
network device or controller fails and must be replaced. The failing primary 
controller on a network cannot be readily exchanged with a standby controller 
because the network identifier assigned to the network device, specifically the 
standby controller, is not readily associated with the primary controller. 

Other drawbacks exist due to the physical structure of the control system. 
The control system utilizes a backplane for operably connecting modules for 
communicating throughout the network. Generally, data transfers are sent from a 



central processing unit (CPU) of the primary controller to a network interface 
module of the primary controller via the primary controller's backplane. A 10 
Mb/sec fiber optic cable communicably links the pair of controllers wherein data 
flows between the network interface module of the primary controller and the 
network interface module of the secondary controller. From the secondary 
controller's network interface module, the data must again travel through a 
backplane to reach the CPU of the secondary controller. Communication between 
selected network modules involving the backplane hampers the transfer of data 
and adversely affects the performance of the data transfer. Due to the relatively 
slow backplane interface, this configuration is inadequate when faster data transfer 
rates on the control system are desired. 

The present invention is provided to solve these and other problems. 

Summary of the Invention 

Ti*e present invention is directed to a method and an apparatus for 
exchanging cbntrollers of a control system configured in an active standby, duplex 
or redundant set-bp. The configuration of the control system increases the rate and 
reliability of the data^transfer between the active and standby controllers. It is an 
object of this invention ttKprovide an active standby control system integrated on a 
communication network cap^le of replacing a controller without significantly 
disrupting the performance of thfcvcontrol system or the network. 

One embodiment of the present invention is directed to a method of 
providing an active standby control systesp. A first (primary) and a second 
(secondary) controller, each controller having an operating state, are operably 
connected to each other and to an 10 module. The first controller, the second 
controller and the 10 module are operably connectedlogether with a network 
connector and a high speed fiber optic network cable tcyfcrm a sub-network. A 
network identifier, i.e., Internet Protocol address, is associated with each 
controller. The operating state of each controller is sensed whebein the network 
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identifier associated with each controller is determined by the operating state of 
each respective controller. Signal communication over the sub-network is 
transmitted over the fiber optic cable at a rate of at least 100 Mb/s. 

The\pntrol system operates normally until a failure in the primary mode 
controller is detected or a controller exchange is selected by an operator. Upon 
detecting a primary mode controller failure, the secondary mode controller 
configured in active standby is substituted in place of the failed primary mode 
controller. The networK^dentifier initially associated with the original primary 
mode controller is associated with the newly substituted primary controller. Thus 
the network identifier of the control system's primary mode controller remains the 
same regardless of which controller is functioning as the primary mode controller. 
The exchange of the controllers is accomplished without significantly disrupting 
the performance of the overall control system by substantially suspending or 
delaying the network's operation. Accordingly, the associated network identifiers 
of the controllers are also exchanged. Alternatively, the Media Access Control 
(MAC) address of controllers can be exchanged. 

A further embodiment of the present invention includes remote IO modules 
such as sensors, relays, gauges, valves, message displays, switches, AC invertors, 
breakers, limit switches, proximity switches, motor starters, motor controllers and 
any other like device as well as traditional IO modules for control systems; 
operably connected to the control system. 

Yet^further embodiment of the present invention is directed to an active 
standby system Jbi^a control system. The active standby system comprises a first 
and a second controller^ch controller comprises a central processing unit having 
an operating state. An IO module is operably connected to the first controller and 
the second controller with a high sp^ed fiber optic network cable and a network 
connector. The high speed fiber optic nehvOTk cable allows a signal to be 
transmitted over the high speed fiber optic neWeric cable at a rate of at least 100 
Mb/s. \. 



5 



\et another embodiment of the present invention is directed to an active 
standby system for a control system. The active standby system comprises a first 
and a second controller. Each controller has an operating state. A high speed fiber 
optic network cable operably connects the first and second controllers for 
transferring data between the controllers at a rate of at least 100 Mb/s. A network 
identifier is assignedNp each controller and is responsive to the operating state of 
the respective controlled. Each controller comprises: a processor; a co-processor; 
an operating system execVted by the processor; and, a co-operating system 
executed by the co-processV wherein the operating system and the co-operating 
system cooperate to transfer data between the first and second controllers. The 
operating system and the co-operating system cooperate to increase the rate of 
signal transmissions by eliminating the need for the signal to be transmitted over a 
backplane. 

Other features and advantages\of the invention, which are believed to be 
novel and nonobvious, will be apparent from the following specification taken in 
conjunction with the accompanying drawings in which there is shown a preferred 
embodiment of the invention. Reference is made to the claims for interpreting the 
full scope of the invention which is not necessarily represented by such 
embodiment. 



Brief Description of the Drawings 

FIGURE 1 is a block diagram showing an active standby control system 
network known by one of ordinary skill in the field of this invention prior to this 
invention; 

FIGURE 2 is a block diagram depicting an embodiment of the present 
invention; and, 

FIGURE 3 is a block diagram of an embodiment of the firmware 
organization of the present invention; and, 



FIGURE 4 is a block diagram depicting an embodiment of the present 
invention. 

Detailed Description of the Preferred Embodiment 
5 While this invention is susceptible of embodiments in many different 

forms, there is shown in the drawings and will herein be described in detail 
preferred embodiments of the invention with the understanding that the present 
disclosure is to be considered as an exemplification of the principles of the 
invention and is not intended to limit the broad aspect of the invention to the 
10 embodiments illustrated. 

Controllers have been integrated with control systems in an active, hot 
standby or aackup configuration wherein the primary controller can be swapped or 
exchanged by^perator personnel with a readily available backup controller when a 
failure to the primary controller is detected. Factory automation networks allow 
15 operator personnel ttr monitor the control system from a remote site. In an active 
standby configuration/a pair of controllers, preferably programmable logic 
controllers, are arranged In communication with each other. One of the controllers 
is designated a primary controller and actively monitors and controls a network 
while the other controller functions in a hot standby mode for backing up the 
20 primary controller. If the prima^controller fails or is taken out of service, the 
backup controller will be swapped iruts place without significantly disrupting 
network operations. An additional concern for a network is the network identifier 
associated with each network device. Each individual device on the network is 
assigned a network identifier, preferably an internet Protocol (IP) address. Thus, 
25 the exchange of controllers on the network alsb requires the exchange of their 
respective network identifiers. 

Shown in FIGURE 1 is an active standby control system 10 generally 
known by one of ordinary skill in the field of this invention. The system 10 
includes a pair of controllers 12 operably connected to a network 13 in a hot 




standby, back-up, redundant configuration. The controller 12 also includes a 
central processing unit (CPU) module 26, a hot standby module 20, and a remote 
10 head 18. The controller's modules are positioned in a rack unit and the location 
of the modules within the rack unit is arbitrary such that the location of each 
module within the rack unit is not standard. The hot standby module 20 of each 
controller 12 is operably connected to each other using a fiber optic cable 17 
capable of handling data transfers at a rate of approximately 10 Mb/s. The CPU 
modules 26 of each controller 12 are operably connected to a processor unit 19 
such as a computer, personal computer or any other device having processing 
capabilities. The serial link 17 connection between the CPU modules 26 can be 
either low-speed or high-speed. The processor unit 19 always communicates with 
the primary controller at the same network identifier regardless of which controller 
12 is functioning as the primary controller. The respective remote 10 heads 18 are 
also connected to each other, and to the local and remote 10 network 23, i.e., drops 
24. 

Existing control systems as shown in FIGURE 1 utilize a backplane during 
data transfers from the primary to the standby controller. The modules shown in 
FIGURE 1 are operably connected to the system 10 and each other through a 
backplane of each controller 12. The modules of each controller 12 must 
communicate with each other to successfully exchange their respective network 
identifiers. Determinism of the system's communication is adversely affected by 
delays or failures in data transfers between the controllers 12. Communication 
between the two controllers requires that data be sent from the primary CPU 
module 26 to the primary hot standby module 20 via the backplane of the 
controller 12, typically including an ASIC interface. The data is further 
transmitted to the hot standby module 20 of the secondary controller via a 10 Mb/s 
fiber optic link 17. The data is then transmitted through the backplane of the 
secondary controller and another ASIC interface of the standby controller to the 
CPU module 26 of the secondary controller. 




FIGURE 2 is directed to an embodiment of the present invention for a 
control system wherein the transfer rate of data between the controllers 12 is 
significantly increased. Each controller includes a CPU module 26. Embedded 
within the CPU module 26 is a dedicated hot-standby transfer port. The 
hot-standby transfer port of each controller 12 is operably connected via a 100 
Mb/s fiber optic cable 17. A processing unit 19 is operably connected to the 
controllers 12, preferably through a Universal Serial Bus (USB) connection or a 
communication card in a PCMCIA slot. As with earlier active-standby control 
systems, the network processing unit 19 communicates with the primary controller 
12 at the same network identifier, regardless of which controller 12 is functioning 
as the primary. 

The present invention significantly improves data transfer rates between 
the controllers by incorporating a higher rated fiber optic cable 17 and eliminating 
a significant portion of data transfers over the backplane. Data is transmitted from 
the primary to the active standby CPU over the 100 Mb/s fiber optic cable 17, 
preferably utilizing Ethernet lOOMb/s. 

The high end CPU 26 shown in FIGURE 2 comprises a processor 27, a 
co-processor (CoPro) 28, an operating system (OS) 30 executed by the processor 
27 and a co-operating system 29 executed by the co-processor 28. The RAM of 
the co-processor 28 executes hot standby data transfers. FIGURE 3. The 
processor 27 and co-processor 28 can be separate or the co-processor can be 
embedded within the processor. Preferably, the co-processor 28 is embedded in 
flash RAM. The embedded co-processor 28 handles data transfers between the 
primary and secondary controllers 12. The transfer of data is over the 100 Mb/s 
fiber optic link 17. In this configuration, the data will no longer need to be 
transmitted over a relatively slow backplane and ASIC interface. Instead, the data 
will travel from the processor's OS 30 to the co-processor's co-operating system 29 
over a much higher internal data bus. The embedded modules facilitate the use of 
standard wiring and transfer protocols throughout the control system network, thus 




increasing the rate of data transfers between the controllers 12. Additionally, it is 
possible to transfer a complete application program stored in one controller, 
regardless of its size. The transfer is accomplished over multiple scans and will 
comprise multiple transfer data packets. 

The direction of the data transfer is shown by the arrows in the FIGURE 3. 
The main functions of the OS 30 include: moving data between the OS 30 
memory and the CoPro's 28 shared memory and directed system checks when 
necessary. The CoPro's functions include: moving data between the primary and 
the standby controllers and transmitting/monitoring the health communication 
signal. 

Specifically, the OS code initiates all hot-standby activity; prepares and 
controls the transfer of data to the CoPro shared memory (primary controller); 
retrieves data from the CoPro's shared memory and places it into the appropriate 
OS memory location (standby controller); interacts with the remote IO (RIO) head 
16 for active standby diagnostics; and controls serial and MB+ address changes on 
the controller. 

The CoPro code builds messages for transmission on the Ethernet 
connection (primary controller); processes incoming data messages and puts data 
in shared memory (standby controller); monitors the health of the Ethernet 
communication; initiates the healthy communication message (primary controller); 
monitors the active standby health communication message; and is responsible for 
all inter-station communication, i.e., change state, application program download 
requests, etc. 

The transfer of data from the primary controller to the standby controller is 
preferably by blocks and includes: state RAM (located variables); all unlocated 
global variables; all instances of DFB and EFB data; SFC variable area and system 
bits and words. It is also possible to upload the configuration and application 
program from the primary controller and download it to the standby controller, 
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thus providing an identical image and enabling the standby controller to take over 
as the primary controller. 

The main processor 30 communicates with the co-processor 28 at the 
beginning of every scan. If the co-processor 28 reports any error, or does not 
respond within a predetermined period, the primary controller will attempt to 
transfer control to the standby controller through the RIO link 18. If the standby 
controller responds, the primary controller releases control and the standby 
controller will operate in stand-alone mode. If the standby controller does not 
respond to the primary controller's request to assume control, the primary 
controller will operate in stand-alone mode and continue to scan the 10. 

When a controller has an error, it can report the error to the other controller 
by sending a message to the other controller through either the fiber optic cable 17 
or the RIO link 18. The controllers 12 can also identify a "failure to respond 
error" by detecting a time-out during the link activity. To ensure that the standby 
controller can detect the error as soon as possible, the primary controller is 
responsible for keeping the links active. This is accomplished by transmitting a 
health communication message to the standby controller every 10 milliseconds 
when no information is being sent via the fiber optic cable 17; and every 5 ms if 
no communication is required with any 10 drop 24 or RIO link 18. If the standby 
controller does not receive the message in the predetermined time, it will attempt 
to determine the cause of the failure and assume control if necessary. 

Each controller 12 has three operating states, i.e., primary, secondary and 
offline. In the primary state, the controller 12 is running and exchanging 10 data 
over the remote 10 network 23. In the secondary state, the controller 12 is 
running, but is not exchanging 10 data over the remote network 23. The primary 
controller can exit the primary state either due to a hardware failure or a self-check 
failure within the controller 12. The state of the secondary controller 12 will 
automatically transition to the primary state if the primary mode controller 12 
leaves the primary state. When the primary controller 12 changes from primary to 




secondary or offline, the controllers 12 will swap their respective network 
identifiers, preferably IP addresses, and the new primary controller 12 will resume 
scanning. When the controllers 12 exchange IP addresses, it appears to the remote 
nodes 24 as if the primary controller has been reset. 

In addition, operator personnel can instruct the control system 10 to change 
the state of the primary control module 12. A control module 12 in the offline 
state cannot enter the primary state without first going through the secondary state. 
The allowable hot standby state transitions for the controllers 12 are: one 
controller is in the primary state and the other controller is in the secondary state; 
one controller is in the primary state and the other controller is in the offline state; 
and both controllers are in the offline state. 

When the controller 12*changes from secondary to primary mode, the 
controllers will exchange their respective network identifiers within ten to fifteen 
milliseconds. The exchange of network identifiers requires the controller to 
perform various cleanup activities. When a swap occurs, the primary will reset the 
10 scanner's connection prior to exchanging the IP addresses. This will minimize 
the time required by the new primary 10 scanner to establish a connection with a 
remote device 24. The time to reset the 10 scanner's connection is in the order of 
several milliseconds. The 10 scanner will establish new connections and start 
scanning in approximately 200 milliseconds. Alternatively, a reverse address 
resolution protocol (RARP) request can be broadcast by the primary controller to 
discover its IP address. In this case, the primary controller broadcasts its physical 
address and a RARP server replies with the primary controller's IP address. 

Figure 4 shows the combination of a remote 10 module 24 with the active 
standby control system (partially shown). The remote IO module 24 is operably 
connected to the active standby control system 10 via a 100 Mb/s fiber optic cable 
18. A network connector 31, preferably an Ethernet switch or hub, facilitates the 
interconnection of the remote 10 24 with the control system 10. The operably 
connected first controller 12, second controller 12 and remote 10 24 form a 
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sub-network. The Ethernet switch 3 1 is implemented to assist in avoiding 
collisions of signal transmissions on the network and maintain determinism of the 
network communication. 

Alternatively, the Ethernet switch 3 1 is used in cooperation with the 
primary controller to control communications on the sub-network from the 
primary controller and to assure that all sub-network communications are managed 
such that only one transaction is outstanding at a time. A master-slave type 
application layer protocol is used in cooperation with the network connector 3 1 to 
facilitate the transmission of signals throughout the sub-network. 

Various types of connectors 3 1 can be implemented in the control system, 
i.e., conventional, non-intelligent, switching intelligent, switching techniques such 
as cross-point (cut-through) and store and forward can be implemented. Generally, 
the switch 3 1 reads the destination address of each frame of data and initiates a 
switching action based upon data stored in the switch's memory, which associates 
destination frame addresses with destination ports. Any other switching method or 
switching technique can be implemented. 

The configuration of the remote IO 24 via the fiber optic cable 18 ensures 
that both the primary and secondary controllers obtain the same IO information. 
The application program for executing the remote IO is present on the processor of 
each controller 12. The monitoring and controlling of the remote IO 24 is 
accomplished by the primary controller. When the IO is performed without the 
primary controller, the Ethernet bandwidth used is very small and generally does 
not affect the controllers' functionality. The use of a switch for the connector 31 
ensures a maximum bandwidth between the controllers during application backup. 

For the redundant control system to function properly, the primary and 
secondary controllers must be solving an identical logic program, which is updated 
on every scan by a data transfer of state RAM between the two controllers. By 
default, the standby controller is set to go offline if a logic mismatch is detected 
between the programs of the standby and primary controllers. A controller swap 
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will not occur if the non-primary controller is offline. An operator of the control 
system can select to override the system default for a logic mismatch and thus 
allow a swap between controllers 12 to occur if a logic mismatch exists between 
the controllers. 

Under normal operating conditions, both controllers 12 have the same 
application program loaded. System checks are in place to detect if there is a logic 
mismatch. A logic mismatch can occur when the application program is initially 
the same on both the primary and secondary controller, but an on-line change has 
occurred to the program of one of the controllers. A logic mismatch can also 
occur when the primary and standby controllers have different applications from 
the onset of the control system's execution. The system's default provides that 
when a mismatch exists, the standby controller is placed in the off-line state and a 
swap of the controllers is not allowed. However, there are situations when it is 
desirable to allow a logic mismatch to exist and to continue to operate the system 
in the active standby configuration. It is important to note that if the settings are 
configured to ignore a logic mismatch and a swap of the controllers is executed, 
the standby controller will assume the role of the primary controller and will 
execute a different application program from the previous controller 12. 

Once an active standby control system is operating, it is normally not shut 
down, even for periodic maintenance. However, there are conditions where the 
user desires to modify the application program without disrupting the control 
system. One situation in which a user may desire to ignore a logic mismatch 
between the controllers is during on-line editing of one of the controller's 
programs. As is readily apparent, any edits executed on-line will immediately 
trigger a logic mismatch between the controllers, therefore the settings on the 
controller must be set accordingly to allow the difference between the two 
programs. After the edits have been made, the user can either use an application 
transfer feature or the processing unit 19 to reload the standby controller with the 
edited primary program. 




The following steps are provided as an exemplification of the on-line 
editing sequence and are not to be used as a limitation to the present invention as 
claimed and disclosed within this application. The logic mismatch feature is 
enabled to allow the standby controller to remain on-line in the event that a logic 
mismatch between the controllers is detected. The user can now make any edits or 
modifications to the application program of the standby controller. After 
completion of the edits, the new program is tested by initiating a switch-over of 
the controllers. If unsuccessful, another switch-over can be initiated to return to 
the original program. If the edits to the program work as expected, an application 
transfer can be executed to synchronize the programs between the controllers. 
Finally, the logic mismatch feature is disabled. Generally, it will not matter 
whether edits to the program application are first made to the primary controller or 
the standby controller. However, any edits made to the application program of the 
primary controller are immediately executed. 

Another situation where it is desirable to ignore a logic mismatch is when a 
systematic shutdown process is implemented in the control system. The 
systematic shutdown process requires the primary controller to be configured to 
control and monitor the normal operation of the control system and the standby 
controller is configured to control a systematic shutdown of the control system in 
the event of a failure to the primary controller. When a problem with the primary 
controller occurs, the controllers will swap and the systematic shutdown procedure 
of the new controller will be executed to shut down the control system. Thus, in 
this type of control system configuration, a logic mismatch exists between the 
controllers, yet it is undesirable to place the standby controller in an off-line mode. 

Some controller application programs are written wherein the programmer 
controls the logical and physical storage of data. The check for a logic mismatch 
for these types of programs examines both the data and the location of the data. 
Other controller programs are written wherein the programmer only controls the 
logical storage of the data and not the physical storage of the data. In these types 
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of programs, the storage of the data is dynamic and controlled by the platform of 
which the program is run. Therefore, the detection of a logic mismatch will not 
include examining the physical location of the stored data. 

Other situations where it is desirable to ignore a logic mismatch exists 
where support of off-line modified projects are being downloaded to the standby 
controller or when getting up to date process data transferred from the active 
controller. 

A transfer application feature provides the user with the ability to 
configure the standby controller from the primary controller. The transfer 
application copies the full program and ensures that the controllers have identical 
configurations. The transfer is accomplished over the communication link, 
preferably a fiber optic cable 17, operably connecting the control processing units 
of each controller 12. The user requests the transfer through the standby 
controller, preferably at a front panel keypad. The complete application program 
and data, including state RAM, will be copied from the primary controller to the 
standby controller. The standby controller will then validate the transferred 
program and if valid, the CPU will automatically start. The user can specify the 
operating mode to be executed after a program transfer to either "run" or 
"off-line." The transfer can be executed using multiple controller scans to 
minimize the per scan impact on the primary controller. During the transfer, the 
control system is not considered redundant because the standby controller is not 
capable of assuming control if the primary controller fails. 

Scan and transfer times of the controllers can be reduced by configuring a 
portion of RAM as an area not to be included in the transfer of data between the 
controllers. Any area of data designated as a non-transfer area will not be 
included during a transfer of state RAM data from the primary to the standby 
controller. The system operator has flexibility in determining how much or how 
little state RAM is selected for transfer. However, state RAM that is associated 
with critical IO functions should be transferred in every scan. The operator can 
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also select how much data gets transferred in all scans and how much gets 
transferred in pieces over multiple scans. 

The controllers 1 executive programs are also upgradeable without having to 
shutdown the control system. During the upgrade, the control system is not 
considered to be in a redundant configuration. If the primary controller should fail 
prior to the upgrade being complete, the standby controller will not be available to 
gain control as the primary controller. 

While specific embodiments have been illustrated and described, numerous 
modifications come to mind without significantly departing from the spirit of the 
invention and the scope of protection is only limited by the scope of the 
accompanying Claims. 



